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The fundamental lower bounds on the thermodynamic energy cost of measurement and informa- 
tion erasure are determined. The lower bound on the erasure validates Landauer's principle for 
a symmetric memory; for other cases, the bound indicates the breakdown of the principle. Our 
results constitute the second law of "information thermodynamics," in which information content 
and thermodynamic variables are treated on an equal footing. 



The fundamental lower bound on the thermodynamic 
energy cost of information processiiig has been a topic of 
active research [l|, 0, i, UM, H, 0, S i, According 
to Landauer's principle [4|], on average, at least fcBTln2 
of work is required to erase one bit of information from 
a memory. Recent developments in nanoscience have en- 
abled the direct measurement of such minuscule amounts 
of work for small nonequilibrium thermodynamic sys- 
tems JJj. Moreover, advances in molecular devices 12 1 
and nanomachines [iJl have necessitated a deeper under- 
standing of thermodynamic information processing. In 
view of these developments, it is essential to identify the 
fundamental lower bound on the thermodynamic energy 
cost of information processing. In this Letter, we derive 
the minimum work that must be performed on a memory 
for measurement and information erasure. Our results 
are proved rigorously for classical information process- 
ing and proved for quantum information processing after 
making an additional assumption . Our results are inde- 
pendent of the detailed characteristics of the system and 
memory, and therefore, they can potentially be applied 
in many areas of information processing. 

We consider a memory M that stores information on 
the outcome of a measurement. While we formulate M 
as a quantum system, our formulation is also valid in 
the classical limit. Let be the Hilbert space of M. 
We decompose H"^ into mutually orthogonal subspaces 
(fc = 1, 2, • • • , N), where the fc's describe the mea- 
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surement outcomes: H'^ — 0^ We assume that 

outcome "fc" is stored in M if the support of the density 
operator of the memory belongs to H^. Without loss 
of generality, we assume that fc = corresponds to the 
standard state of M. The Hamiltonian of M correspond- 
ing to outcome "fc" is denoted by = Y.i^ki\£ki){£ki\, 
where {|efci)}i is an orthonormal basis set of H^. 

Suppose that we perform a measurement on a ther- 
modynamic system S by an isothermal process at tem- 
perature T and find outcome "fc" with probability pk- 
The information on this outcome is stored in memory M. 
We note that pt depends on the state of the measured 
system S but is independent of the structure of memory 
M. We assume that M is in contact with a heat bath 
B at temperature T. The total Hamiltonian is given by 



H^^{t) = H^{t) + + H^, where = @^Hf, 

and H™^{t) is the interaction Hamiltonian between M 
and B Q. We consider the measurement process from 
t = to i = T and assume that H^{0) = H^{t) = 
and H"'\0) = H"'\t) = 0. 

The initial state of M is assumed to obey the canon- 
ical distribution at temperature T subject to the con- 
straint fc = 0. System S is initially separated from M 
and B. The total density operator is given by pf^^ — 



P? ® /5S!can ® Pc.n, whcrC pS!can ^ exp(-/3i?o^)/Zo^ with 

Zf^ = ti[cxp{- 13 H^)] and p^^,, = eM~l3H^)/Z^ with 
= tr[exp(— We do not assume that the initial 
state of S is in thermodynamic equilibrium. 

Next we perform a measurement on S. First, M uni- 
tarily interacts with system S according to the unitary 
operator Umt- By this interaction, M becomes entan- 
gled with system S. The state of M is then measured and 
projected onto the subspace corresponding to the mea- 
surement outcome "fc." The latter process is described 
by the projection operator = \eki){eki\- Immedi- 
ately after the measurement, the total density operator 
is given by p'^^^ 
that 



Efc ^^intpf^^t^t^t^f • We assume 
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where M^iS are the measurement operators that give 
the positive operator-valued measure (POVM) = 
All-Mki [13]) and /3^^'s are the density operators of 
M and B that are mutually orthogonal. The assumption 
in Eq. ([T]) can be justified for a classical shown 
later. Our results are also applicable to quantum sys- 
tems that satisfy Eq. dT]). We note that pk = tr(_Efe/5f ) — 

J2iPki with pkt = tr{Ml-Mkipf)- Finally, S is detached 
from M and B, and then, M-l-B unitarily evolves accord- 
ing to the unitary operator Uf. The final state is given 
by pF^^ = Ek, Mk^pfMl « UfP^Ul 

Let = -fceTlnZf with = tr[exp(-/3ijf )] be 
the Helmholtz free energy of M with measurement out- 
come "fc," and let pf^ = Y.i{Pki/Pk)pf^ be the post- 
measurement state of M with outcome fc. We define 
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the average change in the free energy due to the mea- 
surement as AF^ = J2kPkFk^ — and the ensemble 
average of work performed on M during the measure- 
ment as ^ EkMtripf^H^) + tripf'^H^)] - 

[tr(/5^can^(f ) + tr(/5^an-H^^)]: whcrc we assume that the 
state of S changes adiabatically during the measurement, 
that is, S does not directly exchange heat with M or B 
during the measurement. In other words, we regard the 
direct energy flows between M and S as work. We have 
also assumed that there is no direct energy flow between 
S and B. 

To relate the information gain from the measure- 
ment to its thermodynamic energy cost, we intro- 
duce the Shannon information H = — X^fcPfel^iPfc of 
the measurement outcomes and the QC-mutual in- 
formation between S and M, / = S{pf) + H + 

Efetr[\/Ifc/5f/E^ln/E^pfv/l^] i, where S{p) = 
— tr(yolnp) is the von Neumann entropy. The QC-mutual 
information I characterizes an effective information that 
is obtained by quantum measurement and satisfies < 
I < H, where I = H if the measurement is error-free and 
classical and J = if no information is obtained from 
the measurement. The QC-mutual information reduces 
to the classical mutual information [15^ in the classical 
limit. 

The first main result of this study is the lower bound 
on the work W^^j^g required for the measurement: 

W^,,,>-kBT{H-I) + AF^. (2) 

The proof of this inequality is given later. We note that 
H — I satisfies < H — I < H; the lower bound on 
the work required increases as the amount of information 
gain / by the measurement increases. The fundamental 
thermodynamic energy cost of measurement can be de- 
termined from inequality regardless of the state of 
the measured system S. For the special case where I = H 
and AF^ = 0, the right-hand side of ^ vanishes; this is 
in agreement with the fact that there is no fundamental 
energy cost for measurement and communication 0, 0] . 
The lower bound of the work for given information con- 
tents {H and /) and thermodynamic constraint (AF^) 
is established by inequality ([2]). 

We now discuss the thermodynamic energy cost of the 
erasure of information obtained by the measurement. 
We treat M-l-B as an isolated quantum system. Sup- 
pose the initial state of M obeys the canonical distri- 
bution such that the probability of measurement out- 
come "/c" is pk- The initial state of M and B is de- 
scribed as pf^ = EfePfcP^can ® P?an, whcrC EE 

exp(— The total system evolves unitarily, and 
the support of the final density operator, from the def- 
inition of information erasure, belongs to the subspace 
corresponding to the standard state k = Q with unit 
probability. Let p^^ be the density operator of the fi- 
nal state of B and M. The work required for the era- 
sure is defined as W^^ = [ti{p^^H^) + ti{p^^H^)] - 
Y.kPkMpt..M) + tr(/3?,„H«)]. The lower bound on 



W^oras is given by 

W^o'fas>fcBTiy-AF^, (3) 

which is the second main result of this study. The proof 
of this inequality is given later. For the special case in 
which F(f = for all k, and hence AF'^ = 0, we obtain 
Wcras ^ knTH] this is in agreement with Landauer's 
principle However, when AF'^ ^ 0, information 

erasure with W^^^ < k^TH, in particular, with W^^^ = 
is possible. Thus, there is no fundamental energy cost 
of information erasure as in the case of measurement. An 
inequality similar but not equivalent to ([3]) has recently 
been derived in Ref. f^. 

Combining ([2]) and ([3]), we obtain 

+ M^c'fas > fceT/. (4) 

This inequality shows that the lower bound on the total 
thermodynamic energy cost of measurement and infor- 
mation erasure depends neither on the Shannon infor- 
mation content nor on the free-energy difference; rather 
the bound depends only on the mutual information con- 
tent between the measured system and the memory. In- 
equality ([4]) expresses the trade-off between the work re- 
quired for erasure and that required for measurement. If 
the work required for erasure is negative, the work re- 
quired for measurement must be positive, and vice versa. 
Although there is no fundamental lower bound on the 
work required only for measurement or only for erasure, 
there exists a fundamental lower bound on their sum. 
This trade-off can be confirmed by considering the special 
model discussed below. Note that in the case of reversible 
measurement with W^^^ — 0, inequality Q reduces to 
^oras — k-QTH . While we have adopted the commonly 
used definitions for measurement and erasure [ij, W^^j^g 
and Wp^as <^an, of course, change if we choose different 
definitions. However, the crucial fact here is that for 
given definitions of W^cas and W^^^ , we can still change 
their ratio by changing the physical structure of the mem- 
ory. 

Inequalities ([!]), ([3]), and ^ constitute the second law 
of "information thermodynamics," in which information 
content and thermodynamic variables are treated on an 
equal footing. In the limit of ^ and / ^ 0, these 
inequalities are equivalent to the conventional second law 
of thermodynamics. 

We now discuss the consistency of our results with 
the second law of thermodynamics. Recently, we have 
identified the upper bound of work that can be ex- 
tracted from a heat bath at temperature T with the as- 
sistance of feedback control by "Maxwell's demon" [§]: 
ly^t < -AF^ + knTI, where W^^^ = -W^ is the work 
extracted by the demon and AF^ is the free-energy dif- 
ference of the controlled system. This upper bound is 
larger than that of the conventional second law of ther- 
modynamics by k^TI. Adding this inequality to ([?]), we 
obtain 

W!^ ^ Wl, - M^rcas - < -AFS, (5) 
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which imphes that the conventional second law of ther- 
modynamics is applicable for the entire system of the 
measured system and the demon. 

As an illustration, we construct a model of memory 
in which information can be erased without work. The 
model includes a Brownian particle moving in a double- 
well potential (upper row in FIG. 1 (a)-(c)) I,!. The 
particle is in the left (right) well when the memory regis- 
ters "0" ("1"). We assume that the height of the poten- 
tial barrier far exceeds both quantum and thermal fluc- 
tuations, so that the barrier is impenetrable, and that 
the potential can be modeled by two boxes (lower row 
in FIG. 1 (a)-(c)) with the volume ratio being t : 1 — t 
(0 < t < 1). We also assume that the double- well po- 
tential can deform into a single-well potential during the 
measurement and erasure. We note that the model illus- 
trated in FIG.l is not applicable to a measured system 
such as the Szilard engine rather it is only applica- 
ble to the memory that stores the measurement outcome 
using the representation of a single- molecule gas. 
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FIG. 1: (Color online) (a)-(c): Memory model that includes 
a Brownian particle moving in a double- well potential (upper 
row) as well as two boxes (lower row), where (a), (b), and 
(c) illustrate symmetric, asymmetric, and single potentials, 
respectively; (d)-(g): information erasure from an asymmetric 
memory; (h)-(j): the state evolution of the memory for the 
case of outcome "1." 

Let the initial probabilities of obtaining outcomes "0" 
and "1" both be equal to 1/2. We consider a quasi- 
static information erasure at temperature T as shown 
in FIG. 1 (d)-(g). First, the memory stores the in- 
formation concerning the outcome of the measurement 
[FIG. 1(d)]. The partition is then moved to the center 
at an average work cost of (fcBT/2)[ln2t 4- In 2(1 — t)] 
[FIG. 1(e)]. The partition is then removed [FIG.l(f)]. 
This removal can be regarded as the free expansion of 
the gas, and therefore no work is required for the re- 
moval. The box is finally compressed at a work cost of 
— kBTlnt, and the memory returns to the standard state 
"0" [FIG. 1(g)]. The total work required for information 



erasure is W^^, = fcBTln2 - (fcBr/2) ln(t/(l - t)). For 
the special case where t = 1/2 (symmetric potential), 
W^cras — In 2, as in the case of Bennett's model 0] . In 
contrast, for t — 4/5, = and no work is required 

for information erasure. In general, W^^^ < A:BTln2 
holds for t > 1/2. Landauer's principle for information 
erasure is valid for a symmetric double- well potential, but 
not for an asymmetric one. The proof of > A:bT In 2 

using statistical mechanics in Ref. @ is valid only for the 
symmetric case. We note that an asymmetric memory 
has also been discussed in Ref. [7]. We also note that 
for the case of quasi-static information processing for a 
given outcome ("0" or "1"), the ensemble average of the 
work always equals the work performed on an individual 
sample. In any case, we must average the work over all 
measurement outcomes. 

We next consider a quasi-static measurement process 
at temperature T. At the initial stage, the memory is 
in the standard state "0." If the measurement outcome 
is "0," the state of the memory does not change. If the 
measurement outcome is "1," the memory interacts with 
the measured system, and the left box of the memory 
expands to the right; this requires ~kBTlii{l/t) of work 
[FIG. 1 (i)]. The box then compresses from the left at a 
work cost of fcBrin(l/(l— i)) until the volume of the right 
box returns to the initial volume [FIG. 1 (j)]. The total 
work required in this case is given by kBTln{t/{l — t)). 
Averaging the work over the measurement outcomes, we 
find that W^^^^ = (/cBT/2)ln(t/(l - t)) is required for 
the measurement. Adding this to W^^^ — kBT\n2 — 
(fcBT/2) ln(</ (1 — i)), we find that the total work required 



for measurement and erasure is W^^^^+W^^^ — ksT In 2; 
the equality in ^ can be attained by using this model. 

More generally, let us consider the entropy balance 
of information erasure. If the density operators of the 
memory, which we denote by p^'s, are mutually orthog- 
onal, then the total entropy of p = '^f.PkPk satisfies 
S{p) ~ H + '^i;PkS{pk), where H is the Shannon infor- 
mation and the S'(/5fe)'s describe the physical entropy of 
the memory. If the S'(pfc)'s are equal, then J^kP^^iPk) 
is independent of {pk}, and therefore, a decrease in H 
must be compensated for by an increase in the entropy 
of an external heat bath due to the unitarity of the en- 
tire system. If the S'(/5fc)'s are not equal, a decrease in 
H can be compensated for by a change in the physical 
entropy of the memory, J^kPk^iPk)- We illustrate this 
fact by using our model. Let V be the volume of the 
box. The physical entropy of the initial and final states 
are [ln{tV)+ln{{l-t)V)]/2 and ln{tV), respectively. The 
Shannon information that the memory stores in the ini- 
tial state is In 2, which reduces to during the erasure 
process. For the case where t — 1/2, the difference be- 
tween the total entropy in the initial and final states is 
— In 2, which must eventually be dissipated into the heat 
bath. On the other hand, for the case where t = 4/5, the 
total entropy does not change during the erasure process. 
In this case, a decrease in the Shannon information can 
be compensated for by an increase in the physical entropy 
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of the memory itself. 

We now prove inequality We first prove Eq. (jT]) 
for a classical case, that is, the case where all den- 
sity operators are diagonal at all times with respect 
to an eigenbasis set corresponding to the classical 
degrees of freedom. Let {\ki)}k,i be the eigenba- 
sis set of M-l-B. For a classical case, we can write 
~/SMB ^ J2k,iPki ® \ki){ki\, where p^-'s are not nor- 
malized. Our task is to show that there exists some 
Mk such that = Mk^pfMl- Let pf = J2s1s\s){s\ 
and /5^can<^pB„ = J:^^^rk^\ki){ki\. Then, {s\pl\s") = 

^s,s" J2s'.Lj '>'ki{ski\Uint\s'lj)qs'{s'lj\Uljs"ki), where 
Ss,s" is the Kronecker delta. Since without loss of gener- 
ality, the unitary matrix of Ui^t in the classical eigenbasis 
can be represented by a permutation matrix for a classi- 
cal case, for a given (s, fc, i), {s'lj\U^^^\ski) is unity for one 
and only one (s', I, j) and is zero otherwise. We then have 
{s\pI\s) = Es'i.i'r rM{skz\UintWlj)qs>{s'l'j'\uUskz). 
By defining Mki = V^{^AUint\lj), we obtain 

Eq. (P). 

Since the time evolution from pf^^ to pf^^ is com- 
posed of the unitary evolution and the projection, we 
have S{pf^^) < S{pf^^). On the other hand, we 
can show that ^(p™^) = H + Y.kPkS^:Z^ ^upfMl ® 
pf'IPk) and that M^/Sf M^, ® pf^/Pk) = 

E^iPk^/Pk)SiMk^pfMl/pk^) + S{pf^). Noting that 
S{MMpfMl) = S{^/^MlMk^^/^) holds and that the 
von Neumann entropy is concave, we can show that 

E^iPk^/Pk)S{Mk^pfMl/pki) < S {^/Kpf VE~k / Pk) ■ 

From the definition of the QC-mutual information con- 

tent I, we obtain EkPhSipf"") ~ ^(pS^can) - S{p\,,) > 
I — H. It follows from Klein's inequality that 
-E/cPfetripfBlnpM ^^^^^ J _ ^(^M _ ^(^B J > 

I — H . From the definition of the work, we finally obtain 
_AF^ + Vl/M^^ > kBT{I - H), which proves inequal- 
ity 0. 



We next prove inequality ((S]). Noting that the evolu- 
tion of is unitary, we have S{p^^)-J2k PkSipf^^^J- 
^(Pcan) ~ From Klein's inequality, we have 

which leads to inequality 

Eighty years ago Szilard discovered the close relation- 
ship between information and thermodynamics and sug- 
gested that "it will be possible to find a more general 
entropy law, which applies universally to all measure- 
ments" [1]. Since Szilard's discovery, this crucial insight 
has been expanded and deepened. In 1951, on the basis of 
a specific model, Brillouin argued that the work is needed 
for the measurement, which compensates for the excess 
work extracted by Maxwell's demon 3]- Later, Bennett 
proposed a model of the demon that can perform mea- 
surement without any work and on the basis of a specific 
model and Landauer's principle argued that the key to 
resolving the paradox of the demon lies in erasing the in- 
formation stored in the demon's memory . Since then, 
it has been widely believed that the work required for 
information erasure compensates for the excess work [T'] . 
In this Letter, we have derived inequalities (jl]) and ^ 
that unify the approach adopted by Szilard, Brillouin, 
and Bennett, and we have shown that what reconciles 
Maxwell's demon with the second law of thermodynam- 
ics is the total work of the measurement and erasure, 
which compensates for the excess work of k^TI that can 
be extracted by the demon. 
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